(Ahsaab) 33 : 51
تُرْجِي مَنْ تَشَاءُ مِنْهُنَّ وَتُؤْوِي إِلَيْكَ مَنْ تَشَاءُ ۖ وَمَنِ ابْتَغَيْتَ مِمَّنْ عَزَلْتَ فَلَا جُنَاحَ عَلَيْكَ ۚ ذَٰلِكَ أَدْنَىٰ أَنْ تَقَرَّ أَعْيُنُهُنَّ وَلَا يَحْزَنَّ وَيَرْضَيْنَ بِمَا آتَيْتَهُنَّ كُلُّهُنَّ ۚ وَاللَّهُ يَعْلَمُ مَا فِي قُلُوبِكُمْ ۚ وَكَانَ اللَّهُ عَلِيمًا حَلِيمًا
You can put off whom you wish from among them, you can take unto you among them whom you wish, there is no blame upon you if you call back any of them you have temporarily set aside; that is better for comfort to their eyes, and they not to grieve, and that they will remain satisfied in what you give to them, and Allah is the Knower, the forbearing.
See explanation 4: 128-120.